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Abstract 

We introduce a measure of complexity in terms of the average number 
of bits per time unit necessary to specify the sequence generated by the 
system. In random dynamical system, this indicator coincides with the 
rate K of divergence of nearby trajectories evolving under two different 
noise realizations. The meaning of K is discussed in the context of 
the information theory, and it is shown that it can be determined from 
real experimental data. In presence of strong dynamical intermittency, 
the value of K is very different from the standard Lyapunov exponent 
Ao- computed considering two nearby trajectories evolving under the 
same randomness. However, the former is much more relevant than the 
latter from a physical point of view as illustrated by some numerical 
computations for noisy maps and sandpile models. 
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1 Introduction 

In deterministic dynamical systems there exist well established ways to define 
the complexity of a temporal evolution in terms of Lyapunov exponents and 
Kolmogorov-Sinai entropy. 

However, the situation becomes much more ambiguous in presence of a 
random perturbation, or more in general a generic randomness, which are 
always present in physical systems as a consequence of thermal fluctuations 
or uncontrollable changes of control parameters and in numerical experiments 
because of the roundoff errors 

In the literature, a first rough conclusion is that the presence of a small 
noise does not change the qualitative behaviour of the dynamics ||. In the 
case of a regular (stable) system, the random perturbation just changes the 
very long time behavior by introducing the possibility of jumps among different 
attractors (stable fixed points, stable limit cycles or tori). A familiar example 
is the Langevin equation describing the motion of an overdamped particle in a 
double well. 

Even in the opposite limit of chaotic dissipative systems, the presence of 
noise is expected not to change the qualitative behavior in a dramatic way. 
The typical situation is the following: 

a) the strange attractor maintains the fractal structure at larger scales, al- 
though it is smoothed at small scale 0(a), if a is the strength of the 
noise; 

b) the value of Lyapunov exponents differs from the unperturbed one of a 
quantity 0(a). 
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However the combined effects of the noise and of the deterministic part 
of the evolution law can produce highly non-trivial, and often intriguing, be- 
haviours |§-|§. Let us mention the stochastic resonance where there is a syn- 
chronization of the jumps between two stable points |9[]-||12| and the phenomena 
of the so called noise-induced order and of the noise-induced instability ||- 

I- 

In our opinion one of the main problem is the lacking of a well define 
method to characterize the "complexity" of the trajectories. Usually 0, f| 0, 
the degree of chaoticity is measured by treating the random term as a usual 
time-dependent term, and therefore, considering the separation of two nearby 
trajectories with the same realization of the noise. In this way it is possible 
to compute the maximum Lyapunov exponent A CT associated to the separation 
rate of two nearby trajectories with the same realization of the stochastic term. 

Some authors thus argue that there exists a phenomenon of noise-induced 
order when at increasing the strength of the fluctuation a, A CT passes from 
positive to negative. Even the opposite phenomenon (noise-induced instability) 
has been observed: at increasing a, X a can pass from negative to positive |J-||. 

Although the Lyapunov exponent A CT is a well defined quantity, it is nei- 
ther unique nor the most useful characterization of complexity. In addition, a 
moment of reflection shows that it is practically impossible to extract A CT from 
experimental data. 

In this paper we introduce a more natural indicator of complexity in ran- 
dom dynamical systems computing the separation rate of nearby trajectories 
evolving in two different realizations of the noise, instead of only one. Let us 
stress that, such a procedure exactly corresponds to what happens when ex- 
perimental data are analyzed by the Wolf et al. algorithm [[R|. Basically, our 
measure of complexity is related to the average number per time unit of bits 
necessary to specify the sequence generated by a random evolution law. 
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The outline of the paper is the following. 

In sect. II we introduce the simplest way to treat the randomness by dis- 
cussing two specific examples: the Langevin equation describing the motion of 
an overdamped particle in a double well and the case of the so-called stochas- 
tic resonance. These two examples provide a clear evidence of the limitations 
that arise when the the Lyapunov exponent is computed by treating the noise 
term as a usual time dependent term as well as of the necessity of a better 
characterization of the complexity of "noisy" systems. 

Sect. Ill and IV are devoted to the definition of an appropriate indicator of 
complexity respectively for dynamical systems with noise and random dynam- 
ical systems. For this last case, where the randomness is not simply given by 
an additive noise, we discuss two examples of systems which can be described 



by random maps: a two block earthquake model j38J and sandpile models [23 
an interesting example of Self-Organized Criticality |24| . 

The basic features of random maps are discussed in a a one-dimensional 
map, which exhibits interesting behaviours like the so-called on-off intermit- 
tency [[35 . 



Sect.V discusses in detail the case of Sandpile models with respect to the 
definition of complexity and to the predictability problem. 

In sect. VI we discuss the results and we draw the conclusions. 



2 The naive approach: the noise treated as a 
standard function of time 

The simplest information about the chaoticity of noisy systems can be obtained 
treating the random term as a usual time-dependent term, and therefore, con- 
sidering the separation of two nearby trajectories with the same realization 
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of the noise. Such a characterization can be misleading, as illustrated in the 
following example. 



2.1 Langevin Equation 

Let us consider the one-dimensional Langevin equation 

dx dV(x) r— ... 

where V(x) diverges for | x |— > oo and it has more than one minimum, e.g. the 
usual double well V = —x 2 /2 + x 4 /4, and r)(t) is a white noise. 

The Lyapunov exponent A CT associated to the separation rate of two nearby 
trajectories with the same realization of the stochastic term rj(t), is 

\ a = Km I In \z(t)\ (2) 

where the evolution of the tangent vector (that should be regarded as an in- 
finitesimal perturbation of the trajectory x(t)) is: 

dz d*V(x(t)) 

Tt = dx^ z{t) - (3) 

Since the system is ergodic with invariant probability distribution P(x) = 
Ce- v ^/ a , one has: 

\ a = lim^oo | In \z(t)\ = - hm^^ \ /„* d 2 xx V(x(t'))dt' = 
-C Jd 2 xx V(x)e~ v ^^ dx = -f J(d x V(x)) 2 e- v ^/ a dx < 
This result is rather intuitive: the trajectory x(t) spends most of the time 
in one of the "valleys" where —d xx V(x) < and only short periods on the 
"hills" where —d xx V(x) > 0, so that there is a decreasing of the average of 
the logarithm of the distance between two trajectories evolving in the same 
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noise realization. Let us remark that in Ref. [|14j], using a wrong argument, an 
opposite result is claimed. 

As matter of fact, < implies a fully predictable process ONLY IF the 
realization of the noise is known. In the case, more sensible, of two initially 
close trajectories evolving in two different noise realizations, after a certain time 
T a , the two trajectories will be very distant since they will be in two different 
"valleys". For o — > 0, by the Kramer formula, one has T a ~ exp AV/cr where 
AV is the difference between the values of V on the top of the hill and on the 
bottom of the valley. 

The result obtained for the one dimensional Langevin equation can be easily 
generalized at any dimension for gradient systems supposing that the noise is 
small enough. 

Let us consider the system 



9V r- 

Xi = — = h V2arj i (5) 

OXi 

where < T]i(t)r]j(t r ) >= Sij5(t — t'). Denoting with R 2 = \ z %\ 2 one has: 



= - E = "( Z W> A ®<t)) < -K*(t))R 2 (t) (6) 

i,j 1 3 

where Z(x) is the minimum eigenvalue of the matrix A whose elements are 



d 2 V 

= S~ o_ • ( 7 ) 



dxidxj 

For the Lyapunov exponent \ a one obtains 



Since /(x) is positive around the minimum it follows that X a < for small 
values of a. From a more rigorous discussion see |T5 . 



2.2 Stochastic resonance with and without noise 



Let us now discuss a deterministic systems close to the onset of chaos when the 
control parameter varies periodically in time. We consider the set of differential 
equations which is a slight modification of the Lorenz model |16 | 



dx/dt = 10 (y — x) 
dy/dt = —xz + R(t)x — y 
dz/dt = xy — \z 



(9) 



where the control parameter has a periodic time variation: 



R{t) = R - A cos(27rt/T). (10) 

In our case, the periodic variations of R roughly mimic the seasonal chang- 
ing on the solar heat inputs. 

An interesting situation is when the average Rayleigh number R is assumed 
to be close to the threshold R cr = 24.74 for the transition from stable fixed 
points to a chaotic attractor in the standard Lorenz model. The value of the 
amplitude A of the periodic forcing should be such that R(t) oscillates below 
and above R cr . For very large T, a good approximation of the solution is given 
by 



x(t) = y(t) = ±^ -(R(t) - 1) z(t) = R(t)-l (11) 

which is obtained by the fixed points of the standard Lorenz model by replacing 
R by R(t). The stability of this solution is a rather complicated issue, which 
depends on the values of R , A , and T. 

If Ro is larger than R cr the solution is unstable. In this case, for A large 
enough (at least Ro — A < R cr ) one observes a mechanism similar to that of 
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the stochastic resonance in bistable systems with random forcing. The value 
of T is crucial: for large T the systems behaves as follows. Let us introduce 



T n ~ nT/2 - T/4 (12) 

the times at which R(t) = R cr . 

For < t < Ti, the control parameter R(t) is smaller than R cr so that the 
system is stable and the trajectory is close to one of the two solutions (eq.|9|). 
For Ti <t < T 2 , one has R(t) > R cr and both solutions (eq.[|) are unstable so 
that the trajectory in a short time relaxes toward a sort of 'adiabatic' chaotic 
attractor. The chaotic attractor smoothly changes at varying R above the 
threshold R cr , but if T is large enough, this dependence can be neglected in 
a first approximation. However, when R(t) becomes again smaller than R cr , 
the 'adiabatic' attractor disappears and, in general, the system is far from 
the stable solutions (eq||). But, since they are attracting, the system relaxes 
toward them. See figure (l.a) 



For a detailed analysis of this behaviour see ref |T? . 

It is worth stressing that the system is chaotic, i.e. the first Lyapunov 
exponent is positive, although the correlation function of the variable z does 
not decay as a consequence of strong correlation between the regular intervals. 

Let us now discuss the effect of a random forcing, of strength a, in the 
case where R(t) — R cr changes sign during the time evolution but the solutions 
(eq.^|), in the absence of the noise, are stable. In practice, we consider the 
Langevin equation 



dx/dt = 10 (y — x) + V2ar]i 

dy/dt = -xz + R(t)x -y + V2ar] 2 (13) 
dz/dt = x y — | z + \^2ar] 3 
where r]i(t) are uncorrelated white noises i.e. < r]i{t)r]j{t') >= 5ij5{t — t'). 
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The numerical study of the model reveals a phenomenology very close to the 
original stochastic resonance. For small values of a one has the same qualitative 
behavior obtained at a = 0, while for a slightly larger than a critical value a cr 
one has an alternation of regular and irregular motions. See figure l.b. Now the 
Lyapunov exponent, computed treating the noise as an usual time-dependent 
term, is negative, i.e. two trajectories, initially close, with the same realization 
of the random forcing do not separate but stick exponentially fast. 

Figures (l.a) and (l.b) show in a clear way how, if noise is involved, one 
can obtains simulations rather close either in the case of a positive Lyapunov 
exponent (fig. l.a) or whit a negative Lyapunov exponent (fig. l.b). 

The two above examples show the limitation of the Lyapunov exponent 
computed treating the noise term as a usual time dependent term for the 
characterization of the "complexity" of noisy systems. 

3 Complexity in dynamical systems with noise 

The main difficulties to define the notion of complexity in a deterministic evo- 
lution law with a random perturbation already appear in ID maps. In fact, 
the generalization to iV-dimensional maps or to coupled ordinary differential 
equations is straightforward. 

Let us therefore consider the model map 

x(t+l)=f[x(t),t]+aw(t) (14) 

where t is an integer and w(t) is an uncorrelated random process, e.g. w are 
independent random variables uniformly distributed in [—1,1]. The maximum 
Lyapunov exponent X a defined in ([2]) is given by the map for the tangent vector: 

z(t + l) = f'[x(t),t}z(t) (15) 
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where /' = df / dx At a = 0, Ao is the Lyapunov exponent of the unperturbed 
map. 

In order to introduce a more natural indicator of complexity in noisy dynam- 
ics it is convenient to follow a quite different approach, where two realizations 
of the noise, instead of only one, are used JT^j . 

Before discussing our alternative definition of chaos in noisy systems, we 
must briefly recall what are the characterization of intermittency in deter- 



ministic dynamical systems. An effective Lyapunov exponent |L{| has been 
introduced to measure the fluctuations of chaoticity 

1, \z(t + t)\ 

It gives the local expansion rate in the interval [t,t + r]. The maximum Lya- 
punov exponent is thus given by a time average along the trajectory x(t): 
A =< 7t > for r — > oo. 

Let us define the new indicator of complexity in the framework of the de- 
terministic map with no random perturbation where it coincides with Ao- Let 
x(t) be the trajectory starting at x(0) and x'(t) be the trajectory starting at 
x'(0) = x(0) + 5x(0) with 5 = 1^(0)1 an d indicate by T\ the maximum time 
such that \x'(t) — x(t)\ < A. Then, we put x'(ti + 1) = x{t\ + 1) + 5x(0)and 
define T2 as the maximum r such that \x\t\ + r) — x(t\ +t)\ < A and so on. 
In our context, we can define the effective Lyapunov as 

7i=-h£ (17) 

However, we sample the expansion rate in a non-uniform way, at time intervals 
Tj. As a consequence the probability of picking 7, is Pi = r^j J2i T i so that 

Ao=<7,>=%^= iln(^) , r=K*±jbr i (18) 

This definition without any modification can be extended to noisy systems by 
introducing the rate 
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(19) 



which coincides with Ao for a deterministic system (a = 0). When a = there 
is no reason to determine the Lyapunov exponent in this apparently odd way, 
of course. However, the introduction of K a is rather natural in the framework 
of the information theory |2(J . Considering again the noiseless situation, if one 
wants to transmit the sequence x(t) (t = 1, 2, ...T max ) accepting only errors 
smaller than a tolerance threshold A, one can use the following strategy: 

(1) Transmit the rules which specify the dynamical system (1), using a finite 
number of bits which does not depend on the length T max . 

(2) Specify the initial condition with precision 5q using a number of bits 
n = ln2(A/5o) which permits to arrive up to the time T\ where the error 
equals A. Then specify again the new initial condition x[j\ + 1) with 
a precision Sq and so on. The number of bits necessary to specify the 
sequence with a tolerance A up to T max = J2i=i t% is — Nn and the mean 
information for time step is ~ Nn/T max = K a /\n.2 bits. 

In presence of noise, the strategy of the transmission is unchanged but 
since it is not possible to transmit the realization of the noise w(t), one has 
to estimate the growth of the error 5x(t) = x'(t) — x(t), where x(t) and x'(t) 
evolve in two different noise realizations w(t) and w'(t), and |5x(0)| = 5q. 

The resulting equation for the evolution of 5x(t) is: 

5x(t + 1) ~ f'[x(t),t]6x(t) +crw(t) w(t) =w'(t)-w(t) (20) 

For sake of simplicity we discuss the case \f'[x(i), i]\ = const = expAo, 
where fl2"DD gives the bound on the error: 



Sx(t)\ < e 



(So + cr) 



with a 



e A _ i 



(21) 
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This formula shows that 5o and r = r are not independent variables but they 
are linked by the relation 

e XoT (5 + a) ~ A (22) 

As a consequence, we have only one free parameter, say r, to optimize the 
information entropy K a in (|19D, so that the complexity of the noisy system can 
be estimated by 

G a = min K a = A + 0(a/A) (23) 

where the minimum is reached at an optimal time r = r opt from the transmitter 
point of view. 

In the case of a deterministic system K a does not depend on the value of r 
(i.e. it is equivalent to use a long r and to transmit many bits few times or a 
short r and to transmit few bits many times). On the contrary, in noisy systems 
there exists an optimal time r opt which minimizes K a : using relation ( |2"T| ) one 
sees that A = exp(A T)(<5o + a) and K a has a minimum for r opt ~ 1/A CT . This 
result might appear trivial but has a relevant consequence from a theoretical 
point of view in presence of noise, even if the value of the entropy G a changes 
only 0(ct/A), there exists an optimal time for the transmission. 

The interesting situation happens for strong intermittency when there is 
an alternation of positive and negative 7 during long time intervals. In this 
case the existence of an optimal time for the transmission induces a dramatic 
change for the value of G a . This becomes particularly clear when considering 
the limit case of positive 71 in an interval T\ » I/71 followed by a negative 72 
in an interval T2 >> I/I72I, and again a positive effective Lyapunov exponent 
and so on. In the expanding intervals, one can transmit the sequence using 
~ Ii/(7i In 2) bits, while during the contracting interval one can use only few 
bits. Since in the expanding intervals, the transmission has to be repeated 
rather often and moreover \Sx\ cannot be lower than the noise amplitude a, 
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at difference with the noiseless case, it is impossible to use the contracting 
intervals to compensate the expanding ones. This implies that in the limit of 
very large T only the expanding intervals contribute to the evolution of the 
error 5x(t) and the information entropy is given by an average of the positive 
effective Lyapunov exponents: 

G rT ~< 1 6( 1 )> (24) 

For the approximation considered above, G a > X a =< 7 >. Note that by 
definition G a > while \ a can be negative. The estimate (^) stems from the 
fact that Sq cannot be smaller than a so the typical value of Tj is 0(l/ji) if 
ji is positive. We stress again that fl24|) holds only for strong intermittency, 
while for uniformly expanding systems or rapid alternations of contracting and 
expanding behaviors G a ~ \ a . 

It is not difficult to estimate the range of validity of the two limit cases G G ~ 
\ a and G a ~< 7^(7) >. Denoting by 7+ > and 7_ < the typical values 
of the effective Lyapunov exponent in the expanding and contracting time 
intervals of length T + and T_ respectively, fl2~3|) holds if during the expanding 
intervals there are at least two repetitions of the transmission and the duration 
of the contracting interval is long enough to allow the noise to be dominant 
with respect to the contracting deterministic effects. In practice one should 
require 

exp ( 7+ T+) » - exp (-| T _| TJ) » - (25) 
a a 

In a similar way, K ~ Ao holds if: 

exp(-| 7 _|T_) < — (26) 
a 

We report the results of some numerical simulations in two different systems 
which are showed in fig. 2, and 3, respectively. Let us stress that we have 
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directly computed K a , and since 7* = 0(1/7$), we automatically are very close 
to the optimal strategy so that K a ~ G a , without performing a minimization. 
The random perturbation w(t) is an independent variable uniformly distributed 
in the interval [-1/2, 1/2]. 

The first system is given by periodic alternation of two piecewise linear 
maps of the interval [0, 1] into itself: 

( ax modi if (2n - 1)T < t < 2nT; 
f[x,t) = { (27) 
[bx if 2nT <t < (2n + 1)T 

where a > 1 and 6 < 1. Note that in the limit of small T, G a — > max[A CT ,0] 
since it is a non-negative quantity as shown in fig. (2) where for b = 1/4 , A CT is 
negative. 

The second system is strongly intermittent without an external forcing. It 
is the Beluzov-Zhabotinsky map [4,7] related to a famous chemical reaction: 



/(*) 



1/8-x) 1 / 3 + a]e~ x + b if < x < 1/8; 
(x-l/8)V 3 + a]e-* + b if 1/8 < x < 3/10; (28) 
c(10xe- 10x/3 ) 19 + b if 3/10 < x 
with a = 0.50607357,6 = 0.0232885279, c = 0.121205692. The map exhibits 
a chaotic alternation of expanding and very contracting time intervals. Al- 
though the value of T_ is very small because |7_| >> 1, the first inequality 



(25) is unsatisfied because the expanding time interval are rather short. As a 
consequence the asymptotic estimate G a ~< 7^(7) > cannot be observed. In 
fig 3, one sees that while A passes from negative to positive values at decreasing 
cr, G a is no sensitive to this transition to 'order'. Another important remark is 
that in the usual treatment of the experimental data, if some noise is present, 
one practically computes G a and the result can be completely different from 
A CT . Let us mention for example [H where the author studies a one-dimensional 
nonlinear time-dependent Langevin equation. A numerical computation shows 
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that X a is negative while the author claims to find, using the Wolf method, a 
positive 'Lyapunov exponent'. 

Our results show that the same system can be regarded either as regular 
(i.e. X a < 0) when the same noise realization is considered for two nearby 
trajectories or as chaotic (i.e. G a > 0) when two different noise realizations are 
considered. The situation is similar to what observed in fluids with lagrangian 
chaos. There, a pair of particles passively advected by a chaotic velocity field 
might remain closed following together a 'complex' trajectory. The lagrangian 
Lyapunov exponent is thus zero. However a data analysis gives a positive 
Lyapunov exponent because of the 'eulerian' chaos. We can say that X a and 
G a correspond to the lagrangian Lyapunov exponent and to the exponential 
rate of separation of a particle pair in two slightly different velocity fields, 
respectively. 

The relation G a ~< 7^(7) > is, in some sense, the time analogous of the 
Pesin relation h ~ 9{Xi) between the Kolmogorov- Sinai entropy h and 
the Lyapunov spectrum J22] where the negative Lyapunov exponents do not 
decrease the value of h since the contraction along the corresponding direc- 
tions cannot be observed for any finite space partition. In the same way the 
contracting time intervals, if long enough, do not decrease G a . 

It is important to note that the limit o —>■ is very delicate. Indeed for 
small a, say a < o c , the inequality fl26[) will be fulfilled and G a — X a — ► A for 
cr — ► 0. However in strongly intermittent systems T_ can be very long so that 
the noiseless limit G a — > A is practically unreachable, as illustrated by fig 3. 
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4 Complexity in random dynamical systems 

In this section we discuss dynamical systems (mainly maps) where the ran- 
domness is not simply given by an additive noise, as in sect. 3. This kind of 
systems has been the subject of much interest in the last few years in relation 



with problems involving disorder [33, 34], the characterization of the so-called 



on-off intermittency [[35[] and the modelling of transport problems in turbulent 
flows PB| . In these systems, in general, the random part represents an ensemble 
of hidden variables, that is unknown observables, believed to be implicated in 
the dynamics: the turbulent convection in the solar cycle or several economic 
factors for the stock market prices are just two examples of this situation. The 
random part can, also, represents the effect of a set of variables which vary in a 
chaotic way or that vary on a time scale very small respect to the time scale of 
the phenomenon under investigation. Random maps exhibit very interesting 
features ranging from stable or quasi-stable behaviours, to chaotic behaviours 
and intermittency. In particular on-off intermittency is an aperiodic switching 
between static, or laminar, behaviour and chaotic bursts of oscillation. It can 
be generated by systems having an unstable invariant manifold, within which 
is possible to find a suitable attractor (i.e. a fixed point). The intermittency 
is linked, in the simplest case, to the loss of stability of the fixed point. For 
further details we refer to ^5f . 

A random map can be defined in the following way. Denoting with x(t) the 
state of the system at the discrete time t, the evolution law is given by 

x(t + l)=F(x(t),/(t)) (29) 

where I(t) is a random variable (r.v.). If the r.v. I(t) is discrete with an 
entropy h s , according the general ideas discussed in sect. 3, a measure of the 
complexity of the evolution ca be defined in terms of mean number of bits that 
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must be specified, at each iteration, in order to have a certain tolerance A on 
the knowledge of the state x. 

Of course, it is possible to introduce a Lyapunov exponent Xj, which is the 
analogue of X a , computed considering the evolution of the tangent vector of 
eq. (^9|) once given the realization 1(1), 7(2), I(t) of the random process. 

Therefore, there are two different contributions to the complexity: 

(a) one has to specify the sequence 7(1), 7(2), 7(£) which implies h s /ln2 
bits per iteration; 

(b) if Xi is positive, one has to specify the initial condition x(0) with a preci- 
sion A exp _A/T where T is the time length of the evolution; it is necessary 
to give Xi In 2 bits per iteration; if A/ is negative the initial condition can 
be specified using a number of bits which does not depend on T. 

Therefore, the complexity of the dynamics can be measured as 

K = h s + Ai0(A 2 ), (30) 

where 9 is the Heaviside step function. 

We stress again that a negative value of Xi does not implies predictability. 



4.1 Two examples of random maps 

As specific example, we discuss a random map that is obtained from the de- 
terministic chaotic evolution of a model made of two sliding blocks [^UJ (see 
also POP on a rough surface. Such a model provides a good description of the 



dynamics of two coupled large segments of a fault. 

The equations of motion for the position of the two blocks during a slip can 
be written as 
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Y 1 + Y 1 + a{Y l - Y 2 ) = 
Y 2 + Y 2 + a{Y 2 - Fx) = 



1 



l+7\Yi-v 



(31) 



l+7\Yz-v 



while when one of the two blocks sticks, one has 



Y-i 







Y 1 = v 



(32) 



or 



Y 2 







Y 2 = v 



(33) 



respectively if \Y X + a (Yi - Y 2 )\ < 1, or \Y 2 + a (Y 2 - Yi)| < (3, where the 
Yi are the rescaled displacements from the equilibrium position, a and 7 are 
related to the coupling constants and the friction dynamical coefficient. The 
quantity T v = u^ 1 is the natural (adimensional) time unit of the system. For 



Although there is no randomness in the starting model one can obtain a 
random map in a new set of physically relevant variables. In sliding blocks 
models, the seismic moment (proportional to the released energy) is the sum 
of the sliding runs during a single seismic event, that is 



where Y^n) is the position of the i th block before the n th slip. As shown in fig 
4, the map M n+1 versus M n of the seismic moment computed at subsequent 
events is multi-valued on the definition domain. This is a general feature 
which must be taken into account when analyzing realistic signals generated 
from dynamical systems exhibiting low- dimensional chaos. 

Since some points have more than one image, an appropriate description of 
the dynamics is through a random map where a weight is assigned to each pos- 
sible option. A good approximation of the deterministic evolution is obtained 
even considering the same weights for the two options. 



details on the model see Ref . PH| . 
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(34) 



i=i 
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Another interesting example of a system which can treated in the framework 
of random maps is represented by the so-called Sandpile models ||23|| . These 
models represent an interesting example of Self- Organized Criticality (SOC) 
23, 55], |2j| [27], ^8] . This term refers to the tendency of large dynamical systems 



to evolve spontaneously toward a critical state characterized by spatial and 
temporal self-similarity The original Sandpile Models are cellular automata 
inspired to the dynamics of avalanches in a pile of sand. Dropping sand slowly 
grain by grain on a limited base, one reaches a situation where the pile is 
critical, i.e. it has a critical slope. That means that a further addition of sand 
will produce sliding of sand (avalanches) that can be small or cover the entire 
size of the system. In this case the critical state is characterized by scale- 
invariant distributions for the size and the lifetime and it is reached without 
the fine tuning of any critical parameter. 

We will refer in particular to the so-called Zhang model ||30|| , a continuous 
version of the original sandpile model (the BTW model) p3[ , defined on a 
d- dimensional lattice. The variable on each site Ei (interpretable as energy, 
sand, heat, mechanical stress etc.) can vary continuously in the range [0, 1] 
with the threshold fixed to E c — 1. The dynamics is the following: 

(a) we choose a site in random way and we add to this site an energy S 
(rational or irrational); 

(b) if at a certain time t a site, say i, exceeds the threshold E c a relaxation 
process is triggered defined as: 



E^O 

(35) 

E-^ — > ft-. + ^ 

J -'i+nn 7 ^i+nn \ 2d 

where nn indicates the 2d nearest neighbours of the site i; 



(c) we repeat point (b) until all the sites are relaxed; 
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(d) we go back to point (a). 



We can also define a deterministic version of this model in which, at each 
addition time, we increase the variable of every site of a quantity 5 and then 
follow the same rules as above updating all the sites over threshold in a parallel 
way. 

The dynamics of this model can be seen as described by a Piecewise linear 
Map In fact, indicating with x = {xi} i£D the configuration of the system 
at a certain time, where D C Z d is the bounded domain whose cardinality is 
| D \— N d with iV being the linear dimension of the lattice, the operator Aj 
corresponding to a toppling at site % is given by 

1 * 

(Aj ■ x)j = xj - SijXi + — $i',j x i (36) 

where XT means the sum over the nearest neighbours site of i. 

Eq.(|36D shows that the single toppling is a linear operator and acts as a 
local laplacian. The evolution of a configuration up to the time t can be written 



as 



x 



(t) = T l x = L X:t x + L x ,t- s +ih( s y, (37) 



8=1 



where L Xjt is a linear operator defined as a suitable product of linear operator 
A, xo is the initial configuration and lj is a vector in R D whose component 
i is 1 and all the others are 0. k(s) defines the sequence of site over which 
there will be the random addition of energy at the time s. The (\F7\) shows as 
the evolution of the Zhang model can be seen as the sequential application of 
maps, chosen, time by time, in a random way. Sandpile models, thus, belong 
to the wide class of the random maps. 
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4.2 A toy model: one dimensional random maps 

Let us discuss a random map which, in spite of its simplicity, captures some 
basic features of this kind of systems: 



x(t + 1) = a t x(t)(l -x(t)) (38) 
where a t is a random dichotomic variable given by 

4 with probability p 
a t = { (39) 

1/2 with probability l — p 
It is easy to understand the behaviour for x(t) close to zero. The solution of 
fl3~8l) , keeping the linear part is: 

x(t) = n%x(0). (40) 

3=0 

The long-time behaviour of x(t) is given by the product Ilj=o a j- Using the 
law of large numbers one has that the typical behaviour is 



x(t) ~ x(0)e </na> *. (41) 

Since < Ina >= plnA + (1 — p)lnl/2 = (3p — l)ln2 one has that, for 
p < p c = 1/3, x(t) — > for t — > oo. On the contrary for p > p c after a certain 
time x(t) is far from the fixed point zero and the non- linear terms are relevant. 
Fig. (5) shows a typical on-off intermittency behaviour for p slightly larger than 

Pc- 

Let us note that, in spite of this irregular behaviour, numerical computa- 
tions show that the Lyapunov exponent Xj is negative for p < p c ~ 0.5: this is 
essentially due to the non-linear terms. 
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For such a system with on-off intermittency it is possible, in practice, to 
define a complexity of the sequence which turns out to be much smaller than 
the value given by the general formula fl30|). 

Let us denote with 1^ and Zj the average life times respectively of the laminar 
and of the intermittent phases for p close to p c (lj « II). It is easy to realize 
that the mean number of bits, per iteration, one has to specify in order to 
transmit the sequence is: 

K ~ ^ ~ U2) 

{k + l L )ln2 l L ln2' y ' 

The previous formula is obtained noting that on an interval T one has ~ 
j-^f intermittent bursts. Since during the intermittent bursts, i.e. x(t) far 
from zero, there is not an exponential growth of the distance between two 
trajectories initially close and computed with the same sequence of a t . So, one 
has just to give the sequence of a t on the intermittent bursts. Eq.p2|) has an 
intuitive interpretation: in systems with a sort of "catastrophic" events, the 
most important feature is the mean time between two subsequent events. 
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5 The case of Sand-piles models 



In this section we discuss the problem of the predictability in Sandpile Models 

H, 

Different authors [] suggested that Self- Organized Critical systems occupy 
a particular position among the dynamical systems which has been named 
Weak Chaos. This because it has been argued that the maximum Lyapunov 
exponent of these systems is zero. From this it is deduced that two initially 
close trajectory in the phase space will diverge just algebraically in time and 
not in an exponential way, as do the chaotic systems. From this point of 
view these systems would seem more predictable than chaotic systems in that 
a better knowledge of the initial conditions would considerably improve the 
predictability time T p 



T p ~ (A max /5 ) a . (43) 

where 5$ is the error on the determination of the initial conditions, A max 
is the maximum tolerance between the real evolution and the simulation that 
makes any prediction and a is just the exponent of the algebraic divergency of 
the error. We recall that for chaotic systems the predictability time is given by 

T p = l/T./n(^L). (44) 

In this case an improvement in 5q would increase T p just in a logarithmic 
way. 

In this context we would like to discuss this problem on the basis of some 



recent rigorous results |29| in order to clarify the role of the Lyapunov exponents 
for these class of systems and to address the problem of the predictability. 
We will refer to the Zhang model defined in sect. 4.1. 
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The evolution of a configuration up to the time t is given by the fl37|) 
which shows as the evolution of the Zhang model can be seen as the sequential 
application of maps, chosen, time by time, in a random way. 

The Lyapunov exponent corresponding to a given trajectory x(t) = T l x 
can be defined, linearizing the dynamics in the neighborhood of x(t), as ( ||31|| ): 



A = lim -Zn-tM; (45) 
*-°of |^(0) | v ; 

where z(t) represents the distance between two different configurations x 

and y at the time t. In example, in the L l norm z(t) = J2i \Vi(t) ~ x i(t)\ 

with i — 1, N d . If the two trajectories x(t) and y(t) make the same sequence 

of toppling eq.fl4*5D holds with the substitution y — x — > z. In fact, in this 

case, it holds T l y — T l x = T l z = z(t). Therefore the definition (4~5) for the 



Lyapunov exponent fail when the two configuration begin to follow different 
sequences of toppling. It is easy to see that such a situation occurs when, for 
one configuration, it holds Xi(t) = 1 for some i and t. In this case a little 
difference in the second configuration y^t) = Xi(t) + e will produce a toppling 
just in the y configuration. From this point onwards the two configurations 
will follow different sequences and the definition (4~5) fails definitely. 



It is easy to see that the Lyapunov exponent is not positive. In fact, the 
dynamics in the tangent space, the dynamics of a little difference between two 
configurations, follows the same rules of the usual dynamics and the "error" is 
redistributed to the nearest neighbours site. 

It is then clear that the distance between two configurations, being con- 
served in the toppling far from the boundaries, can just decrease when a site 
of the boundary topples. We can conclude that A < 0. 

In |Z5 it has been obtained rigorously that, for the maximum Lyapunov 



exponent A, as defined in it holds: 
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- N d (R(D) + l) 2 (l/5 +l)(logN d + l) v ' 

where we indicated with R(D) the diameter of the domain D, that is that 
the Lyapunov exponent is strictly lower than 0. 

An immediate consequence of this Theorem is that the dynamics, up to the 
time t ( for t sufficiently large) is given by a Piecewise Linear Contractive Map. 

At first, one could think that the existence of a negative Lyapunov expo- 
nent should assure a perfect predictability. That is not true. What makes the 
situation complex is the existence of a splitting mechanism in the configuration 
space which affect the so-called snapshot attractor. A snapshot attractor is ob- 
tained by considering a cloud of initial conditions and letting it evolve forward 
in time under a given realization of the noisy dynamics. We can identify two 
different mechanism which concur to the formation of the snapshot attractor: 

(a) a volume contraction mechanism due to the effect of the negative Lya- 
punov exponent; 

(b) a splitting mechanism which tends, by virtue of the piecewise structure 
of the map, to map single sets of configurations in two or more distinct 
sets also far apart in the phase space. 

The splitting mechanism (b) tends to create a partition of the configuration 
space in regions which follow the same sequence of toppling, whereas mecha- 
nism (a) tends to contract the volumes of the elements of the partition. 

It is worth to stress how, in same cases, it happens that the evolution of all 
the possible configurations shrink to the evolution of a single configuration (a 
point in the configuration space) whose evolution corresponds, at each time, 
to a snapshot attractor given by just one point. 
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This happens, in example, in the case of a on-dimensional (linear) chain 



of L sites driven with an arbitrary 5. In |29j it has been studied the case 
in which 5 = 1/2 and it has been shown that in this case the partition is 
time- independent. Let us discuss, for sake of simplicity and without loss of 
generality, this last case. A certain cloud of configurations, i.e. belonging 
to a same element of the partition, will evolve in a cloud of configurations, 
in principle smaller than the initial one due to the contractivity of the map, 
belonging entirely to another element of the partition; at its turn this cloud will 
evolve in a smaller cloud of configurations belonging to another element of the 
partition and so on. This process continues until all the configurations shrank 
to just one that continues to evolve jumping between different elements of the 
partition and evolving according to the map corresponding to each element of 
the partition. The Lyapunov exponent, in this case, gives informations about 
the rate of shrinking of the different clouds of configurations, i.e. it gives the 
typical exponential contracting rate of the radius of the snapshot attractor. 

The rigorous study of the properties of the snapshot attractors is out of the 
purposes of present work and it will be treated elsewhere. Here we just want 
to note how this situation does not change the problem of the predictability in 
that, in order to forecast the system, one should be able to know the random 
sequence which drives it. 

This puts the problem of the definition of a predictability in a wider per- 
spective in which the Lyapunov exponent is not the only relevant quantity. 
Since the Lyapunov exponent gives informations only at very large time and 
for infinitesimal perturbations the dynamical balance of the two effects (a) and 
(b) represents a basis for the definition of a predictability for such a systems. 

Let us consider initially the situation in which two different configurations 
are driven with the same realization of the noise: that means that at each time 
the sand (energy) is added to the same sites for the two configurations. 
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Up to the time in which two different configurations make the same se- 
quence of toppling the error e ( the distance between the two configurations) 
will decrease. When the configurations begin to follow a different sequence of 
toppling the error e become of order 1 in a single time step whatever was e be- 
fore this time. From this point onwards the evolution of the distance between 
two configurations seems far from being linked to the Lyapunov exponent. 
The threshold mechanism, and then the splitting mechanism, plays therefore 
a crucial role in determining the predictability of such a systems. The system 
remains definitely predictable up to the time in which two different configu- 
rations make the same sequence of toppling. This time can be defined as the 
predictability time. For a more complete treatment of this point we refer to 
]32| . In particular it is possible show how a predictability for such a class of 



models can be related to a threshold mechanism, in which the Lyapunov expo- 
nent is not the only relevant quantity. Smaller is the initial distance between 
the two configurations, smaller will be the probability of different toppling. 
The threshold in the initial distance between the two configurations, say ej-, 
has, in this probabilistic value. If e(t = 0) < we cannot exclude the 

possibility that the configurations will follow different sequences of toppling, 
but the probability associated with this event become exponentially small as 
the time goes on because, due to the negative Lyapunov exponent, two different 
configurations tend to converge each other. 

In order to confirm these predictions we simulated the parallel evolution of 
two different configurations in the random case (for a system with L = 30) with 
different starting error e and we plotted the distance (in the L 1 norm) between 
the two orbits. Fig.(6-a,b) show the results respectively for e = 10~ 2 and 10~ 3 . 
These results seem to confirm the existence of a probabilistic threshold in e 
which determines the divergence or the asymptotic convergence of two orbits. 
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5.1 Predictability with different realizations of the ran- 
domness 

It is very interesting to investigate what happens when one considers the case, 
more relevant from the point of view of the predictability, in which two con- 
figurations are driven by different randomness. That means that at each time 
the sand is added in different sites for the two realizations. Obviously we can 
imagine a situation in which the uncertainty in the knowledge of the noise can 
be varied. In fact chosen a site for one configuration, we can drive the other 
configuration putting the sand in a site which can be one of the nearest neigh- 
bours sites, or one of the second nearest neighbours sites etc. of the site of the 
first configuration. In this way, due to the discrete structure of the system, the 
uncertainty cannot be reduced at will. The minimum uncertainty is obtained 
putting the sand in one of the nearest neighbours of the site chosen for the 
first configuration. In our simulations we considered this last situation. The 
results are shown in fig. (7). As it is possible to see, the situation in this case 
is much more involved and the threshold mechanism, described above for the 
case of the same realizations of the randomness, does not hold anymore. That 
is because, in this case, the two configurations can start to follow different 
sequences of toppling at the first toppling. From this point onwards we return 
to the situation in which, with the same realization of the noise, the two con- 
figurations start to follow different sequences of toppling; the system become 
unpredictable. Also in this case the Lyapunov exponent does not play the role 
of the only relevant quantity. 

In order to better explain this point it is possible to define the complexity 
K for such kind of systems. In this case we can use the fl30|) of Sect. 4 which 
we write again, for sake of clarity: 
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K = h a + X I 9(X I ), (47) 

where h s defines the complexity relative to the choose of the random se- 
quence of addition of energy. In Sandpile models, for example, since each site 
has the same probability to be selected, one has h s = logL, where L is the 
number of sites of the system and the second term does not exist in that the 
Lyapunov exponent is negative. We then obtain the result that the complex- 
ity for sandpile models is just determined by the randomness in the choose of 
the sequence of addition of energy; nevertheless, once this sequence is known, 
the system could be, all the same, unpredictable, at least for some initial con- 
ditions and non inifinitesimal perturbations, due to the splitting mechanism 
cited above. Once more, let us emphasize that a negative Lyapunov exponent 
implies predictability only if the sequence which drives the system is exactly 
known. 
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6 Conclusions 



In this paper we focus the problem of an appropriate definition of the concept 
of complexity in random dynamical systems. 

At first, one could follow a naive approach where the randomness is consid- 
ered as a standard time-dependent term. In this way, the Lyapunov exponent 
A CT is given by the rate of divergence of two initially close trajectories evolving 
under the same realization of the randomness. 

Although well defined from a mathematical point of view, such an approach 
leads to paradoxical situations. For instance, in a system driven by the one- 
dimensional Langevin equation, the existence of a negative Lyapunov exponent 
does not imply the possibility to forecast the future state of the system unless 
one exactly knows the realization of the noise. Another paradox is represented 
by the situation discussed in sect. 2. 2 where two different systems, one with pos- 
itive Lyapunov exponent, and the other with a negative one, appear practically 
undistinguishable. Least but not last, it is practically impossible to extract \ a 
from an analysis of experimental data. 

The main result of the paper is the definition of a measure of complexity 
K in terms of the mean number of bits per time unit necessary to specify 
the sequence generated by the random evolution law. We have also shown 
that from a practical point of view, this definition correspond to consider the 
divergence of nearby trajectories evolving in different noise realizations. The 
great advantage is that K can be extracted from experimental data ||13|| . The 
two indicators K and A CT have a close values and are practically equivalent in 
systems with weak dynamical intermittency. However, in presence of strong 
intermittency (say irregular alternations of long regular periods with sudden 
chaotic bursts) K and \ a become very different and in extreme situations it may 
happen that K is positive while X a negative. It is thus questionable whether 
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such a system is chaotic or regular and to speak of noise induced order. 

A special class of systems well described by our characterization are random 
maps, where at each time step, different possible evolution laws are chosen ac- 
cording to a given probabilistic rule. Sandpile models form an important group 
of systems tan can be described in terms of random maps. The existence of a 
negative Lyapunov exponent does not allow one to capture the basic features 
of these spatially extended systems while our measure of complexity is able to 
describe in an appropriate way the dynamical behaviour. 

It seems to us that the study of the complexity and of the predictability 
is completely understood only in the case of deterministic dynamical systems 
with few degrees of freedom. Our work wants to be a first step toward a deeper 
comprehension of these issues in systems with many degrees of freedom or in 
interactions with many degrees of freedom represented by a noise, problems 
that are still open and sometimes controversial. 
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Figure captions 



Fig.l: (a) z(t) vs. t/T for the system (|): R = 25.5, A = 4. and T = 1600. 
(b) z(t) vs. t/T for the system (0): i? = 20.0, A = 5., T = 1600 and 
V / 2o : = 0.15. 



Fig. 2: fC CT versus T with o = 10 7 for the map ([27D . The parameters of map 
(p7|) are a = 2 and 6 = 2/3 (squares) or 6 = 1/4 diamonds. The dotted 



noiseless limit of -K^. Note that for 6 = 1/4 the Lyapunov exponent Ao- 
is negative. 

Fig. 3 A (j (squares) and (crosses) versus cr for map (|28|). 

Fig. 4 Multi-valued map of the seismic moments: M n+ i versus M n generated 
by equations fl3~T|) where /3 = 2.0, a = 1.2 and 7 = 3.0. 

Fig. 5 x(t) vs. t for the random map ([38], [ITJ) with p = 0.35. 

Fig. 6: Evolution of the distance e between two configurations driven with the 
same realization of the randomness and with a starting distance of: (a) 



Fig. 7: Evolution of the distance e between two initially identical configurations 
driven with different realizations of the randomness. 



line indicates the Pesin-like relation ([24]) while the dashed lines are the 



10~ 2 and (b) 10~ 3 . 
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